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Patent Application of 
Alan Balkany 
for 

TITLE: Hierarchical Method For Storing Data With Improved 

Compression 

CROSS-REFERENCE TO RELATED APPLICATIONS 

Not applicable 

BACKGROUND — FIELD OF INVENTION 

This invention relates to data storage, specifically to an improved 
data compression method. 

BACKGROUND — DESCRIPTION OF PRIOR ART 

Data compression gives data processing systems several performance 
advantages over non-compressed systems: 

1. It allows larger data sets to be contained entirely in main memory. 
This allows faster processing than systems that must access the disk. 

2. It allows a task to be performed while processing fewer bytes. This 
further speeds processing. 
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3. It provides a more compact form for archival, transmission, or 
reading /writing between memory and disk. 

Previous patents have described variants on a hierarchical compression 
scheme. It is necessary to first describe the approaches used in prior 
art. Figs 1 and 2 illustrate the data structures of a scheme that 
represents features common to the following US patents: 5,023,610 
(1991), 5,245,337 (1993), 5,293,164 (1994), 5,592,667 (1994), 5,966,709 
(1999), 5,983,232 (1999). 

Figure 1 shows a set of records to be compressed. Each record has four 
fields: City, First Name, Last Name, and Shoe Size. These fields can be 
considered to be four parallel data input seguences. Each sequence is 
an ordered set of values for one field over the record set. 

Fig 2 shows the tree structure used in prior art to represent this 
record set. At the bottom of Fig 2, the "leaves" of the tree are 
dictionaries (5 0) that each correspond to one field in the record. A 
dictionary contains one entry for each unique value of the corresponding 
field. The entry is the unique value and a count of the number of times 
the value occurred in the stream of values from the field. For example, 
in the City dictionary, the value for one entry is "Detroit" and its 
count is 6. 

When a value is encountered that was previously seen in the input 
sequence, it is not added to the dictionary. Instead, the count 
associated with that value in the dictionary is incremented. 

A token is the (zero-based) order of a value in a dictionary. A token 
uniquely identifies a value in a dictionary. For example, the tokens 0 
and 1 identify the values "John" and "Bill" respectively, in the First- 
Name dictionary in Fig 2. 

The nonleaf nodes ("interior nodes") (5 1) in Fig 2 represent tuples of 
tokens from lower (leaf or interior) nodes. Here, for simplicity, the 
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tuples are all pairs of tokens, each consisting of a left and a right 
member. (Higher-order tuples could also be used)* 

Each interior node here maintains a list of token pairs from its left 
and right child nodes. For example, the interior node above the Last- 
Name and Shoe-Size leaves (5 2) contains pairs of tokens from these 
fields' dictionaries on the left and right. These token pairs are in 
the order their corresponding values were first seen in the Last-Name 
and Shoe-Size input sequences. 

For example, the first left/right pair in (52) is (0, 0). This denotes 
token 0 from the LastName dictionary and token 0 from the Shoe-Size 
dictionary. This stands for the values "Smith" and "9" for the Last- 
Name and Shoe-Size fields in the first record. 

Likewise, the second left/right pair in (52), (1, 1), stands for the 
value pair, ("Doe", "8"), in the second record. Each has a count of 1. 
If a token pair is the same as one recorded earlier, a new entry is not 
made. Instead, the count for that pair is incremented. 

Each unique left/right token pair in an interior node is also assigned a 
token, representing the order that pair was first encountered from the 
left and right child nodes. For example, the tokens 0 and 1 in (5 5) 
correspond to the left /right token pairs, (0, 0) and (0, 1). 

Likewise, the root node, (56), represents unique token pairs from nodes 
(52) and (55), in the order they were first encountered. The root node 
(5 6) represents every unique record in the tree, for example, to 
reconstruct the third record, we look at the third token (token 2) in 
the root node (56). This has left and right values of 1 and 2. 

We look up token 1 in the root's left child (5 5) and get left and right 
values of 0 and 1. This are tokens for values in the City and First- 
Name dictionaries, respectively, which are "Plymouth" and "Bill", from 
the third record. A similar lookup with token 2 in interior node (5 2) 
gives "Smith and "7" for the rest of the record. 
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Note that all the counts for token pairs at the root node are 1. Also 
note that there are consecutive runs where the left and right token 
numbers are each one more than the left and right token numbers in the 
previous entry. This can be seen for tokens 1 through 10 in the root 
node (5 6). For any given token in this range, we can get the left and 
right pair of the next token in the range by adding left and right 
elements of the given token. 

For example, in node (5 6), the left/right pair for token 5 (4, 5) has 
each element one more than the left/right pair for token 4 (3, 4). 

Exhaustively representing all the token pairs in a sequence with such a 
regular pattern wastes a considerable amount of space. 

Also if other trees are constructed to represent subsets of the data in 
the first tree, the dictionary values used must be duplicated in the 
leaves of these other trees. This redundancy also wastes a considerable 
amount of space. It also wastes the processing time it takes to 
duplicate the dictionaries. 

US patent 5,966,709 (1999) described a method of optimizing said tree 
structure. Said method used a variant of the Huffman Algorithm, which 
can produce sub-optimal tree designs when the value function is complex 
or nonmonotonic. Said method also calculates the exact size of a parent 
node by counting the tuples formed by the child nodes joined, which is 
computationally expensive. 

US patents 5,023,610 (1991), 5,245,337 (1993), and 5,293,164 (1994) 
described the compression of a single stream of data, while this 
invention describes the compression of multiple parallel sequences of 
data. 

SUMMARY 

In accordance with the present invention, an improved hierarchical data 
compression method uses: 
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a) a more compact method for representing tuple sequences, which saves 
memory and time, 

b) data dictionaries shared among trees to avoid redundancy, which saves 
memory and time, 

c) an efficient method of processing a subset of a tree's leaves, and 

d) a flexible method of designing the tree. 

Objects and Advantages 

Accordingly, several objects and advantages of my invention are: 

(a) to provide a more compact representation of data, by compressing an 
interior node's tuples, which saves space: 

(1) allowing larger data sets to be contained in main memory, 

(2) speeds the transfer of said interior node between secondary 
storage and main memory, 

(3) speeds the transfer of said interior node over a communication 
channel, 

(4) speeding up processing by allowing a task to be performed while 
processing fewer bytes, and 

(5) allowing data sets to be archived more efficiently; 

(b) to provide a more compact representation of data by separating a 
tree's leaves from their corresponding dictionaries, which: 

(1) saves space when processing multiple trees which share the same 
dictionaries, by avoiding redundant copies of dictionaries 

(2) speeds the transfer of multiple trees between secondary storage 
and main memory, by only having to move one copy of each 
dictionary, 

(3) speeds the transfer of multiple trees over a communication 
channel, 

(4) saves space, allowing multiple trees to be archived more 
efficiently; 
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(5) speeds the creation of subsets of a tree, by avoiding 
rebuilding the dictionaries 

(6) allows further compression by run-length encoding the leaves, 
which can be mainly an array of counts for values; 

(c) to provide an efficient method for accessing a subset of a tree's 
leaves ; and 

(d) to provide a flexible method for designing a tree, which permits a 
variety of design strategies and preference heuristics. 

DRAWING FIGURES 

Fig 1 is a set of records to be compressed 

Fig 2 is prior art compression schemes 

Fig 3 is a schematic of my storage method 

Fig 6 shows the nodes visited and avoided by gating 

Fig 7 shows the algorithm for adding a value to a dictionary 

Fig 9 shows the algorithm for adding a tuple to an interior node that 

stores tuple runs separately 

Fig 10 shows a single tuple being added to a set containing a tuple run 

Fig 11 shows the tuples of Fig 10 represented with my method 

Fig 12 shows the state of the interior node after the tuple addition 

Fig 13 shows the tuples of Fig 12 represented with my method 

Fig 14 shows an algorithm for retrieving a subset of a token record 

Fig 15 shows part of a problem space used in the design of a tree 

Fig 16 shows the general algorithm used to search a problem space 

Reference Numerals in Drawings 

50 leaf node, prior art 

51 interior node, prior art 

52 interior node over Last-Name and Shoe-Size leaves, prior art 

53 the Last-Name dictionary, prior art 

54 the Shoe-Size dictionary, prior art 

55 interior node over City and First-Name leaves, prior art 

56 the root node, prior art 
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57 token 2's entry in the root node, prior art 

60 dictionaries, my method 

61 leaves, my method 

62 interior nodes, my method 

63 the root node, my method 

64 the single-tuple list in the root, my method 

65 the tuple-run list in the root, my method 

66 the City leaf node, my method 

70 the initial state in the tree-design problem space 
71, 72 two states in the problem space 

80 the test whether a new pair extends the current tuple run 
DESCRIPTION- -Preferred Embodiment 

1 . Tree structure 

Fig 3 shows an example of the storage method. The dictionaries (6 0) 
each associate the unique values of a field with a token number* 

The tree leaves (61) are each associated with one dictionary, and 
represent a subset of that dictionary's values. In Fig 3, each leaf 
contains an array of counts, where the nth count is the number of times 
the nth dictionary value occurs in the input data sequence for that 
leaf. 

Definition: Run of unique, mutually-consecutive tuples. 

A sequence of tuples such that the elements of each tuple are each one 
more than the elements of the previous tuple, e.g.: 



{(10, 20) (11, 21) (12, 22) (13, 23)} 
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is a run of mutually-consecutive tuples. If all of the left tokens in 
this run only appear once, in said run, and all of the right tokens in 
this run only appear once, in said run, this run is called a "run of 
unigue mutually-consecutive tuples". We will refer to such a run as a 
tuple run for short. 

Interior nodes (6 2) may store tuple runs separately from individual 
tuples. For example, this is done in the root node (6 3), which 
contains two lists: the first one a list of single tokens (6 4), and the 
second one, a list of tuple runs (65). (For comparison, the root node 
(5 6) in Fig 2 represents exactly the same set of tuples as the root 
node (63) in Fig 3 ) . 

The tuple list (6 4) contains the single tuples corresponding to tokens 
0, 1, and 11. The tuple run list (6 5) contains one run of nine tuples. 
The run list, in this case, takes one ninth as much space as explicitly 
representing the nine tuples. 

2 . Separation of dictionaries and leaves 

Each leaf represents a subset of values from its corresponding 
dictionary. This can be done, for example, with an array of counts, 
such that the nth count is the number of times the nth dictionary value 
occurs in the leaves input data sequence. 

For example, the City leaf (6 6) in Fig 3 contains the counts, "3, 6, 
3". These stand for the number of times the cities, Plymouth, Detroit, 
and Pontiac, respectively, occurred in the City input data sequence. 

A leaf's count array may contain many consecutive repetitions of the 
same count, and may be further compressed using run-length encoding. 



3. Interior node gating 
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Each interior node has an integer, gate, associated with it. When 
access to only a subset of a tree's fields is needed for a record, we 
can speed up the process using the interior nodes' gates. 

We store a value in each gate that tells if either of the interior 
node's subtrees contains a field in the subset we're interested in. 
This allows us to skip searching down subtrees that don't have any 
fields in the subset of fields we're looking for. 

For example, see Fig 6. The shaded nodes are the ones we'd have to 
visit to retrieve values from nodes A, E, and F for a record. The 
number in each interior node in Fig 6 is the gate value to visit only 
leaf nodes A, E, and F. 

A gate value of 0 means neither subtree contains a field in the subset. 
A value of 1 or 3 means the left subtree contains a field in the subset. 
A value of 2 or 3 means the right subtree contains a field in the 
subset. 

Gating here visits 8 of 15 nodes, approximately halving the number of 
node visits required. 

4. Tree construction process 

A tree is constructed for a set of fields which have corresponding 
dictionaries. The design process is modeled as a search of a problem 
space with operators and a value function. 

A problem space is: 

(a) a set of states such that, each state represents a partial tree 
design; the leaves and zero or more interior nodes, each interior node 
the parent of two or more other nodes, 

(b) one or more operators that transform one state to another, and 
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(c) a value function, giving a numeric ranking of the value of any 
state's design, 

The design process starts from an initial state in the problem space, 
and applies operators to move to other states, until an acceptable 
design is reached. 

Typical operators are: (a) joining multiple nodes under a new interior 
node, (b) a delete operation: deleting an interior node and separating 
its child nodes, (c) swapping two nodes* 

Typical value functions may include the sizes of the interior nodes, 
preferences for certain fields to be near each other, and preferences 
that certain fields permit fast access. 

For example, Fig 15 shows part of a problem space. The initial state 
(7 0) of the problem space contains three leaves: A, B, and C. The 
three states the initial state can reach in Fig 15 are each reached by 
applying the "Join" operator. This operator joins two nodes in a state, 
under an new interior node. In each of said three states, two of the 
leaves that were unjoined in the initial state are now joined. 

We can transition from state (7 1) to state (7 2) in Fig 15, using the 
"Swap" operator. This operator exchanges the positions of two nodes, 
here, B and C. 

Applying the swap operator a second time undoes the swap operation, in 
effect, backtracking to the previous state in the problem space. The 
"Delete" operator deletes an interior node, which is the inverse of the 
join operator, so can backtrack from a join. Backtracking allows the 
problem spaced to be searched for an acceptable design. 

DESCRIPTION- -Alternative Embodiments 

(a) Tuple run storage in interior nodes can be selectively enabled, 
storing only single tuples in the nodes where it has been disabled. 



11 

This avoids the overhead of two lists for lower interior nodes, where 
tuple runs are less frequent. 

(b) Leaves can contain an array of Booleans, where the nth Boolean 
is TRUE if the nth dictionary value is present in a tree. This can be 
stored as a bit array, which is more compact than storing the counts, 
and can be further compressed by run-length encoding the bits. 

(c) When designing a tree, the size of an interior node can be 
quickly approximated as a predetermined fraction of the product of said 
interior node's childrens' sizes. Although not optimal, this is much 
faster that the laborious calculation of the parent's exact size 
required by an optimal algorithm. A value of 1/3 for said fraction 
produces reasonable results. 

Operation 

There are four basic operations on my invention: 

1. Dictionary construction 

2 . Tree construction 

3. Token record insertion 

4. Access to a subset of a record 

1 . Dictionary construction 

Fig 3 (6 0) is an example of four dictionaries, each of which 
associates a unique token number with each unique value that occurs in 
one field. Fig 7 shows the algorithm for adding a value to a 
dictionary. If the value is not already in the dictionary, it is added 
to the dictionary, and associated with the next unused token number. 

2. Tree Construction 

Tree construction is modeled as a search through a problem space. See 
Fig 15 for part of a problem space. Fig 16 shows the general algorithm 
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used. Operators are iteratively selected and applied to the current 
design state to obtain the next design state. 

The process terminates when the current state represents an acceptable 
design. By varying the available operators and/or how they are 
selected, different problem-space search behaviors can be produced 

3. Record addition 

When a record is added to a tree, each field value is first processed by 
a dictionary, mapping it to a token number. Thus the record is 
transformed into an equivalent record composed of tokens representing 
the original field values. 

Each interior node has two children which may be either leaves or 
interior nodes. Each pair of tokens from sibling nodes is sent to their 
parent interior node. The parent node checks if this pair (tuple) of 
values is already stored. If not, the tuple of values is associated 
with the next unused token number, and stored in the parent node with a 
count of 1. If it is already stored, its count is incremented. 

The interior node then, in turn, sends the token number associated with 
this pair to Its parent. Thus, at each interior level, pairs (tuples) 
of tokens are recorded and mapped to single tokens. These pairs can 
later be looked up by their associated token number. 

Interior Node Storage 

An interior node has a list of the left/right token pairs it has been 
sent from its left and right children. The interior node may optionally 
keep a list of pair (tuple) runs that have occurred. Fig 9 is a flow 
chart that shows how a pair is added to an interior node that stores 
tuple runs separately. 

When a tuple is added to an interior node, there are four possible 
results: 
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(a) It can extend a tuple run . 

This corresponds to the first decision diamond (80) in Fig 9: "is x = 
lastx +1 & y = lastY + 1 ?". If true, it means the pair, x, y, 
extends a tuple run. Thus, just incrementing the length field of the 
current tuple run records the addition of this pair to this interior 
node. 

(b) It can invalidate one or more existing runs by duplicating any of 
their tokens. 

This situation is illustrated in Figs 10-13. Fig 10 diagrams a tuple, 
(4, 4) being added to a tuple run with six elements. The tuple run 
would actually be represented as in Fig 11, with the following fields: 
(start token, start left value, start right value, run length). So (0, 
1, 1, 6) stands for the run starting with token 0, and left and right 
values starting at (1, 1), and length 6. 

All left and all right values in a tuple run are assumed to occur only 
in that run. The tuple being added in Fig 11, (4, 4), duplicates a 
tuple in the run, thus invalidating that run. The run is then split 
into subruns that do not contain the tuples with duplicated values. 

Fig 12 diagrams the state of the interior node from Fig 10 after the 
tuple (4, 4) has been added. The two resulting subruns omit (4, 4), 
which has been inserted into the single-tuple list. 

The form used inside the interior node is shown in Fig 13. The two 
entries on the left in Fig 13 represent the two runs in the node's tuple 
run list. The first run starts with token 0 and has a length of 3, and 
the second run starts with token 4 and has a length of 2. The entry on 
the right denotes token 3 is associated with left & right values of (4, 
4 ) , and has a count of 2 . 

(c) It may not do either 1 or 2, and is in the single-tuple list. 
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In this case we increment the count associated with the tuple in the 
single-tuple list. 

(d) It may not do either 1 or 2, and the pair is not in the single-tupl 
list. 

In this case, we add the tuple to the single- tuple list with a count of 
one. 

4. Access of Subset of a Record 

To efficiently access a subset of a record, the gate fields of the 
interior nodes are set as previously described. We look at an example 
of accessing a record subset. The algorithm of Fig 14 is applied to a 
tree root to retrieve a token record for a given record number, and a 
subset of the fields. 

See Fig 14. The input to the algorithm is: 

(a) the token number of the record to be retrieved, 

(b) a node to search from 

(c) the location to store the next token retrieved 

The token number originally supplied to the algorithm is the record 
number. The node to search for is initially the root node over the 
subset of fields to be retrieved. 

We look up left and right values from the given token number. If said 
node has a gate value of 1 or 3, we recursively search the node's left 
subtree, with said left value. If said node has a gate value of 2 or 3 
we recursively search the node's right subtree, with said right value. 

When a leaf is reached, we store the given token number at the next 
location in the token record we're constructing. We also increment the 
token- record location to point to the next space. 
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Conclusion, Ramifications, and Scope 

Thus the reader will see that my invention provides a more compact 
method of storing data records. This provides several benefits, 
including fitting larger data sets into main memory, allowing the data 
sets to be processed faster, improving the speed of loading/ storing data 
between main memory and disk, and providing more efficient transmission 
and archival of said data sets. 

An efficient algorithm for retrieving a record subset from this storage 
method is presented. A flexible algorithm for tree design is also 
presented . 

While my above description contains many specificities, these should not 
be construed as limitations on the scope of the invention, but rather as 
an exemplification of one preferred embodiment thereof. 

Accordingly, the scope of the invention should be determined not by the 
embodiment ( s ) illustrated, but by the appended claims and their legal 
equivalents . 
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Sequence Listing 

Not applicable 
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Claims: I claim: 

1 • A method for storing a plurality of parallel data element 
sequences comprising the steps of: 

(a) creating a dictionary of unique values for each of said 
data element sequences, whereby each dictionary 
associates a numeric index with each unique value in the 
corresponding sequence; 

(b) forming an n-ary tree with leaf and interior nodes where: 

(1) each leaf node corresponds to one of said 
dictionaries , 

(2) each interior node associates a numeric index with 
tuples of numeric indexes from other subordinate 
leaf or interior nodes, and 

(3) interior nodes may store sequences of unique, 
mutually-consecutive tuples separately from the 
other tuples, 

2. The method of claim 1, whereby each unique value of a leaf 
node and each unique tuple of an interior node is 
associated with a count of the number of times that value 
or implied tuple of values occurred in the parallel data 
element sequences, 

3. The method of claim 1, further including a means for 
efficiently processing a subset of a tree's leaves, 
comprising the following steps: 

(a) the definition of a gate field in interior nodes, 

(b) setting each of said gate fields' values, to indicate 
which of the corresponding interior node's branches 
lead to leaf nodes in said subset 
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(c) following paths that lead to said leaves, and 

(d) processing the leaves encountered* 

4. The method of claim 1, further including selectively 
disabling separate storage of tuple runs at certain 
interior nodes. 

5. The method of claim 1, further including the method for 
arranging said n-ary tree comprising the steps of: 

(a) defining a problem space consisting of: 

(1) a set of states such that each state contains a 
set of leaves and zero or more interior nodes, each 
with two or more other nodes as children, 

(2) a value function, giving a numeric ranking of the 
value of any state's design 

(b) defining one or more operators that transform one 

state to another, and 

(c) searching the problem space, starting from an initial 
state and applying operators to move to other states 
until a state with an acceptable design is reached. 

A method for storing a plurality of parallel data element 
sequences comprising the steps of: 

(a) creating a dictionary of unique values for each of said 
data element sequences, whereby each dictionary 
associates a numeric index with each unique value in the 
corresponding sequence 

(b) forming an n-ary tree with leaf and interior nodes where: 

(1) each leaf node represents a subset of values from one 
of said dictionaries, and 
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(2) each interior node associates a numeric index with 

tuples of numeric indexes from other terminal or non- 
terminal nodes. 

7. The method of claim 6, whereby each unique value of a leaf 
node and each unique tuple of an interior node is 
associated with a count of the number of times that value 
or implied tuple of values occurred in the parallel data 
element sequences. 

8. The method of claim 6, further including a means for 
efficiently processing a subset of a tree's leaves, 
comprising the following steps: 

(a) the definition of a gate field in interior nodes, 

(b) setting each of said gate fields' values, to indicate 
which of the corresponding interior node's branches 
lead to leaf nodes in said subset 

(c) following paths that lead to said leaves, and 

(d) processing the leaves encountered. 

9. The method of claim 6, whereby an additional tree, t, is 
created using a subset of the same fields of the first 
tree, f, comprising the steps of: 

(a) finding an ancestor node in tree f, of the leaf nodes 
in f corresponding to said subset of fields; 

(b) looking up the tokens of said leaf nodes corresponding 
to a subset of tokens in said ancestor; 

(c) inserting said leaf node tokens into tree, t. 

10. The method of claim 6, further including the method for 
arranging said n-ary tree comprising the steps of: 
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(a) defining a problem space consisting of: 

(1) a set of states such that each state contains a set of 
leaves and zero or more interior nodes, each with two or more 
other nodes as children, 

(2) a value function, giving a numeric ranking of the value 
of any state's design 

(b) defining one or more operators that transform one state to 
another, and 

(c) searching the problem space, starting from an initial state 
and applying operators to move to other states until a state with 
an acceptable design is reached. 
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Hierarchical Method For Storing Data With Improved 

Compression 

Abstract: A hierarchical data-compression method is described, with a 
compact form for sequences of consecutive tuples (and other techniques) 
to save space. A method for efficiently processing a subset of record 
fields is described. A flexible method for designing the data hierarchy 
(tree) is described. 
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